Autonomous Exploration with Expectation-Maximization

نویسندگان

  • Jinkun Wang
  • Brendan Englot
چکیده

We consider the problem of autonomous mobile robot exploration in an unknown environment for the purpose of building an accurate feature-based map efficiently. Most literature on this subject is focused on the combination of a variety of utility functions, such as curbing robot pose uncertainty and the entropy of occupancy grid maps. However, the effect of uncertain poses is typically not well incorporated to penalize poor localization, which ultimately leads to an inaccurate map. Instead, we explicitly model unknown landmarks as latent variables, and predict their expected uncertainty, incorporating this into a utility function that is used together with sampling-based motion planning to produce informative and lowuncertainty motion primitives. We propose an iterative expectation-maximization algorithm to perform the planning process driving a robot’s step-by-step exploration of an unknown environment. We analyze the performance in simulated experiments, showing that our algorithm maintains the same coverage speed in exploration as competing algorithms, but effectively improves the quality of the resulting map.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Self-exploration of the Stumpy Robot with Predictive Information Maximization

One of the long-term goals of artificial life research is to create autonomous, self-motivated, and intelligent animats. We study an intrinsic motivation system for behavioral self-exploration based on the maximization of the predictive information using the Stumpy robot, which is the first evaluation of the algorithm on a real robot. The control is organized in a closed-loop fashion with a rea...

متن کامل

Comparison of Information Theory Based and Standard Methods for Exploration in Reinforcement Learning

Exploration is a key part of reinforcement learnning. In the classic setting, autonomous agents are supposed to learn a model of their environment to succesfuly complete a task. Recent works in the field and in related fields have suggested the use of quantities based on Shannon’s information theory to enable agents to do so. The underlying concepts of exploration vary between those works. In t...

متن کامل

Compliant skills acquisition and multi-optima policy search with EM-based reinforcement learning

The democratization of robotics technology and the development of new actuators progressively bring robots closer to humans. The applications that can now be envisaged drastically contrast with the requirements of industrial robots. In standard manufacturing settings, the criterions used to assess performance are usually related to the robot’s accuracy, repeatability, speed or stiffness. Learni...

متن کامل

Effective exploration strategies for the construction of visual maps

We consider the effect of exploration policy in the context of the autonomous construction of a visual map of an unknown environment. Like other concurrent mapping and localization (CML) tasks, odometric uncertainty poses the problem of introducing distortions into the map which are difficult to correct without costly on-line or postprocessing algorithms. Our problem is further compounded by th...

متن کامل

Reinforcement Learning in Robotics: Applications and Real-World Challenges

In robotics, the ultimate goal of reinforcement learning is to endow robots with the ability to learn, improve, adapt and reproduce tasks with dynamically changing constraints based on exploration and autonomous learning. We give a summary of the state-of-the-art of reinforcement learning in the context of robotics, in terms of both algorithms and policy representations. Numerous challenges fac...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017